Delays in accessing high-quality care for newborns in East Africa: An analysis of survey data in Malawi, Mozambique, and Tanzania.

Background: Despite the existence of evidence-based interventions, substantial progress in reducing neonatal mortality is lagging, indicating that small and sick newborns (SSNs) are likely not receiving the care they require to survive and thrive. The 'three delays model' provides a framework for understanding the challenges in accessing care for SSNs. However, the extent to which each delay impacts access to care for SSNs is not well understood. To fill this evidence gap, we explored the impact of each of the three delays on access to care for SSNs in Malawi, Mozambique, and Tanzania. Methods: Secondary analyses of data from three different surveys served as the foundation of this study. To understand the impact of delays in the decision to seek care (delay 1) and the ability to reach an appropriate point of care (delay 2), we investigated time trends in place of birth disaggregated by facility type. We also explored care-seeking behaviours for newborns who died. To understand the impact of delays in accessing high-quality care after reaching a facility (delay 3), we measured facility readiness to manage care for SSNs. We used this measure to adjust institutional delivery coverage for SSN care readiness. Results: Coverage of institutional deliveries was substantially lower after adjusting for facility readiness to manage SSN care, with decreases of 30 percentage points (pp) in Malawi, 14 pp in Mozambique, and 24 pp in Tanzania. While trends suggest more SSNs are born in facilities, substantial gaps remain in facilities' capacities to provide lifesaving interventions. In addition, exploration of care-seeking pathways revealed that a substantial proportion of newborn deaths occurred outside of health facilities, indicating barriers in the decision to seek care or the ability to reach an appropriate source of care may also prevent SSNs from receiving these interventions. Conclusions: Investments are needed to overcome delays in accessing high-quality care for the most vulnerable newborns, those who are born small or sick. As more mothers and newborns access health services in low- and middle-income countries, ensuring that life-saving interventions for SSNs are available at the locations where newborns are born and seek care after birth is critical.

Validation of maternal recall of number of antenatal care visits attended in rural Southern Nepal: a longitudinal cohort study.

OBJECTIVES: This study aimed to examine the validity of maternal recall of total number of antenatal care (ANC) visits during pregnancy and factors associated with the accuracy of maternal recall. DESIGN: This was a longitudinal cohort study conducted from December 2018 through November 2020. SETTING: Five government health posts in the Sarlahi district of Southern Nepal. PARTICIPANTS: 402 pregnant women between ages 15 and 49 who presented for their first ANC visit at the study health posts. MAIN OUTCOMES: The observed number of ANC visits (gold standard) and the reported number of ANC visits at the postpartum interview (maternal recall). RESULTS: On average, women in the study who had a live birth attended 4.7 ANC visits. About 65% of them attended four or more ANC visits during pregnancy as recommended by the Nepal government, and 38.3% of maternal report matched the categorical ANC visits as observed by the gold standard. The individual validity was poor to moderate, with the highest area under the receiver operating characteristic curve (AUC) being 0.69 (95% CI: 0.65 to 0.74) in the 1-3 visits group. Population-level bias (as distinct from individual-level bias) was observed in the 1-3 visits and 4 visits groups, where 1-3 visits were under-reported (inflation factor (IF): 0.69) and 4 ANC visits were highly over-reported (IF: 2.12). The binary indicator ANC4+ (1-3 visits vs 4+ visits) showed better population-level validity (AUC: 0.69; IF: 1.17) compared with the categorical indicators (1-3 visits, 4 visits, 5-6 visits and more than 6 visits). Report accuracy was not associated with maternal characteristics but was related to ANC frequency. Women who attended more ANC visits were less likely to correctly report their total number of visits. CONCLUSION: Maternal report of number of ANC visits during pregnancy may not be a valid indicator for measuring ANC coverage. Improvements are needed to measure the frequency of ANC visits.

Association between antenatal care facility readiness and provision of care at the client level and facility level in five low- and middle-income countries.

BACKGROUND: Despite growing interest in monitoring improvements in quality of care, data on service quality in low-income and middle-income countries (LMICs) is limited. While health systems researchers have hypothesized the relationship between facility readiness and provision of care, there have been few attempts to quantify this relationship in LMICs. This study assesses the association between facility readiness and provision of care for antenatal care at the client level and facility level. METHODS: To assess the association between provision of care and various facility readiness indices for antenatal care, we used multilevel, multivariable random-effects linear regression models. We tested an inflection point on readiness scores by fitting linear spline models. To compare the coefficients between models, we used a bootstrapping approach and calculated the mean difference between all pairwise comparisons. Analyses were conducted at client and facility levels. RESULTS: Our results showed a small, but significant association between facility readiness and provision of care across countries and most index constructions. The association was most evident in the client-level analyses that had a larger sample size and were adjusted for factors at the facility, health worker, and individual levels. In addition, spline models at a facility readiness score of 50 better fit the data, indicating a plausible threshold effect. CONCLUSIONS: The results of this study suggest that facility readiness is not a proxy for provision of care, but that there is an important association between facility readiness and provision of care. Data on facility readiness is necessary for understanding the foundations of health systems particularly in countries with the lowest levels of service quality. However, a comprehensive view of quality of care should include both facility readiness and provision of care measures.

Exploring approaches to weighting estimates of facility readiness to provide health services used for estimating input-adjusted effective coverage: a case study using data from Tanzania.

The ideal approach for calculating effective coverage of health services using ecological linking requires accounting for variability in facility readiness to provide health services and patient volume by incorporating adjustments for facility type into estimates of facility readiness and weighting facility readiness estimates by service-specific caseload. The aim of this study is to compare the ideal caseload-weighted facility readiness approach to two alternative approaches: (1) facility-weighted readiness and (2) observation-weighted readiness to assess the suitability of each as a proxy for caseload-weighted facility readiness. We utilised the 2014-2015 Tanzania Service Provision Assessment along with routine health information system data to calculate facility readiness estimates using the three approaches. We then conducted equivalence testing, using the caseload-weighted estimates as the ideal approach and comparing with the facility-weighted estimates and observation-weighted estimates to test for equivalence. Comparing the facility-weighted readiness estimates to the caseload-weighted readiness estimates, we found that 58% of the estimates met the requirements for equivalence. In addition, the facility-weighted readiness estimates consistently underestimated, by a small percentage, facility readiness as compared to the caseload-weighted readiness estimates. Comparing the observation-weighted readiness estimates to the caseload-weighted readiness estimates, we found that 64% of the estimates met the requirements for equivalence. We found that, in this setting, both facility-weighted readiness and observation-weighted readiness may be reasonable proxies for caseload-weighted readiness. However, in a setting with more variability in facility readiness or larger differences in facility readiness between low caseload and high caseload facilities, the observation-weighted approach would be a better option than the facility-weighted approach. While the methods compared showed equivalence, our results suggest that selecting the best method for weighting readiness estimates will require assessing data availability alongside knowledge of the country context.

How does social desirability bias influence survey-based estimates of the use of antenatal care in rural Nepal? A validation study.

OBJECTIVES: Social desirability bias is often speculated to influence survey responses but seldom studied in healthcare. The objective was to explore whether social desirability scores (SDS) or the presence of interview observers is associated with inaccurate recall and overestimation of antenatal care (ANC) services. DESIGN: Longitudinal validation study comparing recalled receipt of ANC services and nutrition components of ANC against direct observations of care. An adapted short form Marlowe-Crowne questionnaire was used to generate an SDS, and the presence of interview observers was treated as a separate exposure. We assessed accuracy and overestimation of recalled receipt of ANC services against observed receipt using log-binomial regression, adjusting for age, education, first-pregnancy and socioeconomic status. SETTING: Rural Southern Nepal with recruitment from five government health posts. PARTICIPANTS: 401 pregnant women. RESULTS: Social desirability scores did not significantly predict accuracy or overestimation of most types of ANC care except counselling on nausea. Higher SDS was associated with more accurate recall (adjusted RR, aRR 1.08 (95% CI 1.03, 1.12)) and less overestimation (aRR 0.85 (0.80, 0.91)). The presence of mothers-in-law or husbands during interviews was associated with greater overestimation of the number of ANC visits received by more than three visits (aRR 2.07 (1.11, 3.84)) and (aRR 4.19 (2.17, 8.10)), respectively. Those interviewed with friends present tended to overestimate the receipt of counselling on nausea, avoiding alcohol and not smoking. CONCLUSION: The presence of observers can lead to overestimation of the receipt of ANC care and support the conduct of interviews in private settings despite challenges of doing so in village contexts. Findings that the SDS did not predict the accuracy of most types of ANC care might reflect a reality that such questions may not be sensitive from a social-norms perspective. Additional local adaptation of SDS is recommended.

Moderate Accuracy of Survey Responses about Infant and Young Child Feeding Counseling Reported by Mothers with Children Less than 1 Year of Age in India.

BACKGROUND: Counseling on infant and young child feeding (IYCF) to support optimal breastfeeding and complementary feeding practices is an essential intervention, and accurate coverage data is needed to identify gaps and monitor progress. However, coverage information captured during household surveys has not yet been validated. OBJECTIVES: We examined the validity of maternal reports of IYCF counseling received during community-based contacts and factors associated with reporting accuracy. METHODS: Direct observations of home visits conducted by community workers in 40 villages in Bihar, India served as the "gold standard" to maternal reports of IYCF counseling received during 2-wk follow-up surveys (n = 444 mothers with children less than 1 y of age, interviews matched to direct observations). Individual-level validity was assessed by calculating sensitivity, specificity, and AUC. Population-level bias was measured using the inflation factor (IF). Multivariable regression models were used to examine factors associated with response accuracy. RESULTS: Prevalence of IYCF counseling during home visits was very high (90.1%). Maternal report of any IYCF counseling received in the past 2 wk was moderate (AUC: 0.60; 95% CI: 0.52, 0.67), and population bias was low (IF = 0.90). However, the recall of specific counseling messages varied. Maternal report of any breastfeeding, exclusive breastfeeding, and dietary diversity messages had moderate validity (AUC > 0.60), but other child feeding messages had low individual validity. Child age, maternal age, maternal education, mental stress, and social desirability were associated with reporting accuracy of multiple indicators. CONCLUSIONS: Validity of IYCF counseling coverage was moderate for several key indicators. IYCF counseling is an information-based intervention that may be received from various sources, and it may be challenging to achieve higher reporting accuracy over a longer recall period. We consider the modest validity results as positive and suggest that these coverage indicators may be useful for measuring coverage and tracking progress over time.

The effect of sampling health facilities on estimates of effective coverage: a simulation study.

BACKGROUND: Most existing facility assessments collect data on a sample of health facilities. Sampling of health facilities may introduce bias into estimates of effective coverage generated by ecologically linking individuals to health providers based on geographic proximity or administrative catchment. METHODS: We assessed the bias introduced to effective coverage estimates produced through two ecological linking approaches (administrative unit and Euclidean distance) applied to a sample of health facilities. Our analysis linked MICS household survey data on care-seeking for child illness and childbirth care with data on service quality collected from a census of health facilities in the Savanes region of Cote d'Ivoire. To assess the bias introduced by sampling, we drew 20 random samples of three different sample sizes from our census of health facilities. We calculated effective coverage of sick child and childbirth care using both ecological linking methods applied to each sampled facility data set. We compared the sampled effective coverage estimates to ecologically linked census-based estimates and estimates based on true source of care. We performed sensitivity analyses with simulated preferential care-seeking from higher-quality providers and randomly generated provider quality scores. RESULTS: Sampling of health facilities did not significantly bias effective coverage compared to either the ecologically linked estimates derived from a census of facilities or true effective coverage estimates using the original data or simulated random quality sensitivity analysis. However, a few estimates based on sampling in a setting where individuals preferentially sought care from higher-quality providers fell outside of the estimate bounds of true effective coverage. Those cases predominantly occurred using smaller sample sizes and the Euclidean distance linking method. None of the sample-based estimates fell outside the bounds of the ecologically linked census-derived estimates. CONCLUSIONS: Our analyses suggest that current health facility sampling approaches do not significantly bias estimates of effective coverage produced through ecological linking. Choice of ecological linking methods is a greater source of bias from true effective coverage estimates, although facility sampling can exacerbate this bias in certain scenarios. Careful selection of ecological linking methods is essential to minimize the potential effect of both ecological linking and sampling error.

The RADAR coverage tool: developing a toolkit for rigorous household surveys for reproductive, maternal, newborn, and child health & nutrition indicators.

Population-based intervention coverage data are used to inform the design of projects, programs, and policies and to evaluate their impact. In low- and middle-income countries (LMICs), household surveys are the primary source of coverage data. Many coverage surveys are implemented by organizations with limited experience or resources in population-based data collection. We developed a streamlined survey and set of supporting materials to facilitate rigorous survey design and implementation. The RADAR coverage survey tool aimed to 1) rigorously measure priority reproductive, maternal, newborn, child health & nutrition coverage indicators, and allow for equity and gender analyses; 2) use standard, valid questions, to the extent possible; 3) be as light as possible; 4) be flexible to address users' needs; and 5) be compatible with the Lives Saved Tool for analysis of program impact. Early interactions with stakeholders also highlighted survey planning, implementation, and analysis as challenging areas. We therefore developed a suite of resources to support implementers in these areas. The toolkit was piloted by implementers in Tanzania and in Burkina Faso. Although the toolkit was successfully implemented in these settings and facilitated survey planning and implementation, we found that implementers must still have access to sufficient resources, time, and technical expertise in order to use the tool appropriately. This potentially limits the use of the tool to situations where high-quality surveys or evaluations have been prioritized and adequately resourced.

Cognitive testing of questions about antenatal care and nutrition interventions in southern Nepal.

Large scale surveys such as the Demographic and Health Surveys (DHS) are used to measure the coverage and quality of antenatal care (ANC)-related services. Studies have increasingly validated questions from these surveys, though few have explored respondent comprehension or associated thought processes. This study aimed to use cognitive testing and validation approaches to understand how survey respondents understand questions related to ANC-related nutrition services. The study was nested within a larger validation study in southern Nepal. Pregnant women's receipt of ANC related services was directly observed at five health posts followed by a recall interview at 6 months postpartum. A week later, a survey module was re-administered to 30 women containing 15 questions about receipt of ANC care and specifically nutrition-related services. Detailed probing was used to identify cognitive challenges related to comprehension, retrieval, judgement, and response. Respondents accurately recalled the four specific ANC visits recommended by the government of Nepal but those with more visits struggled to estimate the total number of ANC visits they had made. A number of terms including "antenatal care, "nutrition" and "breastfeeding" were challenging for many respondents to understand. Visits to private providers including for ultrasounds were inconsistently included in ANC visit counts suggesting that question wording could better specify the type of care. Many respondents over-estimated the number of iron folic acid (IFA) supplements taken during pregnancy, and recall was challenging. Calculations were based on estimating the number of months between first ANC visit to delivery, and only sometimes factored in missed tablets. Opportunities exist to improve questions to facilitate better comprehension by respondents through a combination of using local terms and explanations, reordering some questions, and adapting questions to better match respondents' approaches to estimating numeric responses.

Measuring and monitoring child health and wellbeing: recommendations for tracking progress with a core set of indicators in the Sustainable Development Goals era.

Although great improvements in child survival were achieved in the past two decades, progress has been uneven within and across countries, and the COVID-19 pandemic threatens to reverse previous advances. Demographic and epidemiological transitions around the world have resulted in shifts in the causes and distribution of child death and diseases, and many children are living with short-term and long-term chronic illnesses and disabilities. These changes, plus global threats such as pandemics, transnational and national security issues, and climate change, mean that regular monitoring of child health and wellbeing is essential if we are to achieve the Sustainable Development Goals. This Health Policy describes the three-phased process undertaken by the Child Health Accountability Tracking technical advisory group (CHAT) to develop a core set of indicators on child health and wellbeing for global monitoring purposes, and presents CHAT's research recommendations to address data gaps. CHAT reached consensus on 20 core indicators specific to the health sector, which include 11 impact-level indicators and nine outcome-level indicators that cover the topics of: acute conditions and prevention; health promotion and child development; and chronic conditions, disabilities, injuries, and violence against children. An additional six indicators (three impact and three outcome) that capture information on child health issues such as malaria and HIV are recommended; however, these indicators are only relevant to high-burden regions. CHAT's four research priorities will require investments in health information systems and measurement activities. These investments will help to increase data on children aged 5-9 years; develop standard metadata and data collection processes to enable cross-country comparisons and progress assessments over time; reach a global consensus on essential interventions and associated indicators for monitoring emerging priority areas such as child development, chronic conditions, disabilities, and injuries; and implement strategies to increase the uptake of data on child health to improve evidence-based planning, programming, and advocacy efforts.

Validation of MINORMIX Approach for Estimation of Low Birthweight Prevalence Using a Rural Nepal Dataset.

BACKGROUND: The Global Nutrition Target of reducing low birthweight (LBW) by ≥30% between 2012 and 2025 has led to renewed interest in producing accurate, population-based, national LBW estimates. Low- and middle-income countries rely on household surveys for birthweight data. These data are frequently incomplete and exhibit strong "heaping." Standard survey adjustment methods produce estimates with residual bias. The global database used to report against the LBW Global Nutrition Target adjusts survey data using a new MINORMIX (multiple imputation followed by normal mixture) approach: 1) multiple imputation to address missing birthweights, followed by 2) use of a 2-component normal mixture model to account for heaping of birthweights. OBJECTIVES: To evaluate the performance of the MINORMIX birthweight adjustment approach and alternative methods against gold-standard measured birthweights in rural Nepal. METHODS: As part of a community-randomized trial in rural Nepal, we measured "gold-standard" birthweights at birth and returned 1-24 mo later to collect maternally reported birthweights using standard survey methods. We compared estimates of LBW from maternally reported data derived using: 1) the new MINORMAX approach; 2) the previously used Blanc-Wardlaw adjustment; or 3) no adjustment for missingness or heaping against our gold standard. We also assessed the independent contribution of multiple imputation and curve fitting to LBW adjustment. RESULTS: Our gold standard found 27.7% of newborns were LBW. The unadjusted LBW estimate based on maternal report with simulated missing birthweights was 14.5% (95% CI: 11.6, 18.0%). Application of the Blanc-Wardlaw adjustment increased the LBW estimate to 20.6%. The MINORMIX approach produced an estimate of 26.4% (95% CI: 23.5, 29.3%) LBW, closest to and with bounds encompassing the measured point estimate. CONCLUSIONS: In a rural Nepal validation dataset, the MINORMIX method generated a more accurate LBW estimate than the previously applied adjustment method. This supports the use of the MINORMIX method to produce estimates for tracking the LBW Global Nutrition Target.

Advancing nutrition measurement: Developing quantitative measures of nutrition service quality for pregnant women and children in low- and middle-income country health systems.

The health sector plays an important role in the delivery of high-quality nutrition interventions to women and children in low- and middle-income countries (LMICs). However, there are no standardized approaches to defining and measuring nutrition service quality in these contexts. This study aims to systematically develop quality of care indices for direct health systems nutrition interventions using a five-step process: (1) identify recommended interventions for inclusion in indices, (2) extract service readiness, provision of care, and experience of care items from intervention-specific clinical guidelines, (3) map items to data available in global health facility surveys, (4) conduct an expert survey to prioritize interventions and items, and (5) use findings from previous steps to propose quality of care metrics. Thirty-two recommended interventions were identified, for which the guidelines review yielded 763 unique items that were reviewed by experts. The proposed nutrition quality of care indices for pregnant women reflects eight interventions and the indices for children under 5 reflects six interventions. The indices provide a standardized measure for nutrition intervention quality and can be operationalized using existing health facility assessment data, facilitating their use by LMIC decision makers for planning and resource allocation.

Using cognitive interviewing to bridge the intent-interpretation gap for nutrition coverage survey questions in India.

Designing survey questions that clearly and precisely communicate the question's intent and elicit responses based on the intended interpretation is critical but often undervalued. We used cognitive interviewing to qualitatively assess respondents' interpretation of and responses to questions pertaining to maternal and child nutrition intervention coverage. We conducted interviews to cognitively test 25 survey questions with mothers (N = 21) with children less than 1 year in Madhya Pradesh, India. Each question was followed by probes to capture information on four cognitive stages-comprehension, retrieval, judgement, and response. Data were analysed for common and unique patterns across the survey questions. We identified four types of cognitive challenges: (1) retention of multiple concepts in long questions: difficulty in comprehending and retaining questions with three or more key concepts; (2) temporal confusion: difficulty in conceptualizing recall periods such as "in the last 6 months" as compared to life stages such as pregnancy; (3) interpretation of concepts: mismatch of information being asked, meaning of certain terms and intervention scope; and (4) understanding of technical terms: difficulty in understanding commonly used technical words such as "breastfeeding" and "antenatal care" and requiring use of simple alternative language. Findings from this study will be useful for stakeholders involved in survey design and implementation, especially those conducting large-scale household surveys to measure coverage of essential nutrition interventions.

Validation of maternal report of nutrition-related interventions and counselling during antenatal care in southern Nepal.

The delivery of nutrition-related interventions and counselling during antenatal care is critical for a healthy pregnancy for both mother and child. However, the accuracy of maternal reports of many of these services during household surveys has not yet been examined. Our objectives were to assess the validity of the maternal reports of 10 antenatal nutrition interventions, including counselling, and examine associates between maternal characteristics and accuracy. Maternal report of services received collected during a post-partum survey was compared to the gold standard, the direct observation of all women's antenatal care visits. Individual-level validity was assessed by calculating indicator sensitivity, specificity and area under the operating curve (AUC). The inflation factor (IF) measured population-level bias. For five indicators, the high true coverage limited our ability to assess the validity of the maternal reports. There were no indicators that had both high individual-level validity (AUC > 0.70) and low population bias (0.75 < IF < 1.25). Indicators with greater true coverage estimates had higher sensitivity and lower specificity estimates compared to those indicators with lower true coverage. There were no maternal characteristics associated with the accuracy of the report. Maternal report of antenatal nutrition-related interventions and counselling during household surveys was found to have variable validity across indicators. Additional research in settings with varying coverage levels should be considered to best inform antenatal care coverage measurement in household surveys.

Validation of Maternal Report of Receipt of Iron-Folic Acid Supplementation during Antenatal Care in Rural Southern Nepal.

BACKGROUND: Coverage of iron-folic acid (IFA) supplementation is a key indicator for tracking programmatic progress within and across countries. However, the validity of maternal report of this information during household surveys has yet to be determined. OBJECTIVES: This study aimed to examine the validity of maternal recall of receipt of IFA supplementation during antenatal care (ANC) and factors associated with accuracy of maternal recall. METHODS: A longitudinal cohort design was employed. The direct observation of the IFA received during all ANC visits at the 5 study health posts served as the "gold standard" to the maternal report of IFA received during the postpartum interview. Individual-level validity was assessed by calculating indicator sensitivity, specificity, and AUC. The inflation factor (IF) measured population-level bias. A multivariable log-binomial model was used to assess factors associated with accurate recall. RESULTS: The majority (95.8%) of women were observed receiving IFA during pregnancy. Women overreported the number of IFA tablets received compared with what was observed during ANC visits (mean difference: 45 tablets). Maternal report of any IFA receipt was moderate (AUC = 0.60; 95% CI: 0.50, 0.71), and population bias was low (IF = 1.01). However, the individual-level validity was poor across the 7 IFA tablet count categories; the AUC for categories ranged from misleading to moderate. Driven by the trend of maternal overreport, the IF indicated that maternal report drastically underestimated the coverage of lower tablet categories and overestimated the coverage of higher tablet counts. Accuracy of maternal report was not associated with months since last ANC observation nor any maternal characteristics. CONCLUSIONS: Maternal report of the amount of IFA supplementation received during pregnancy produced extremely biased population coverage and performed poorly to moderately for individual-level validity. It is imperative to improve this indicator because it is used in global frameworks and national program planning.

Antenatal care processes in rural Southern Nepal: gaps in and quality of service provision-a cohort study.

OBJECTIVES: This study aimed to compare a standard quality of care definition to one that reflected focused antenatal care (FANC) guidelines and examine associations with receipt of good quality of care. DESIGN: This study was a longitudinal cohort study. SETTINGS: Five government health posts in the Sarlahi district of Southern Nepal PARTICIPANTS: Pregnant women between the ages of 15 and 49 who presented for their first antenatal care (ANC) visit at the study health posts. MAIN OUTCOMES: There were two quality of care definitions: (1) provision of seven services at least once during pregnancy (QOC1) and (2) provision of services to reflect the FANC guidelines by incorporating a frequency of care dimension for certain services (QOC4+). RESULTS: There was variation in service provision both in terms of frequency of provision and by gestational age at the visit. There were 213 women (49.1%) that received good quality care by the first definition, but when the frequency of service provision was included for the second definition the percentage dropped to 6.2%. There were significant differences in provision of quality care by health post for both definitions. The number of visits (QOC1 adjusted risk ratio (aRR) 1.18, 95% CI 1.13 to 1.23; QOC4+ aRR 1.46, 95% CI 1.11 to 2.80) and care during the first trimester (QOC1 aRR 1.22, 95% CI 1.01 to 1.49) and maternal age (QOC1 aRR 1.27, 95% CI 1.03 to 1.58) were associated with greater likelihood of good quality ANC. CONCLUSION: This analysis demonstrated that measuring quality of care by receipt of services at least once during pregnancy may overestimate the true coverage of quality of ANC. Future efforts should improve feasibility of including frequency of care in quality of care definitions.

Can We Use Routine Data for Strategic Decision Making? A Time Trend Comparison Between Survey and Routine Data in Mali.

BACKGROUND: Countries with scarce resources need timely and high-quality data on coverage of health interventions to make strategic decisions about where to allocate investments in health. Household survey data are generally regarded as "gold standard," high-quality data. This study assessed the comparability of intervention coverage time trends from routine and survey data at national and subnational levels in Mali. METHODS: We compared 3 coverage indicators: contraceptive prevalence rate, institutional delivery, and 3 doses of diphtheria, pertussis, and tetanus (DPT3) vaccine, using 3 Mali Demographic and Health Surveys (DHS 2001, 2006, and 2012-2013) and routine health system data covering 2001-2012. For routine data, we used local health information system (HIS) annual reports and an HIS database. To compare time trends between the data sources, we calculated the percentage point change and 95% confidence interval from 2001-2006 and 2006-2012. We then computed the absolute and relative differences between the 2 data sources for each indicator over time at national and regional levels and assessed their level of significance. RESULTS: The direction and magnitude of the time trends of contraceptive prevalence rate, institutional delivery, and DPT3 vaccine from 2001 to 2012 were similar at the national level between data sources. At the regional level, there were significant differences in the magnitude and direction of time trends for institutional delivery and the DPT3 vaccine; contraceptive prevalence trends were more consistent. Routine data tended to overestimate DPT3 coverage, and underestimate institutional delivery and contraceptive prevalence relative to survey data. CONCLUSION: Routine data in Mali-particularly at the national level-appear to be appropriate for use to inform program planning and prioritization, but routine time trends should be interpreted with caution at the subnational level. For program evaluations, routine data may not be appropriate to draw accurate inferences about program impact.

Methodological considerations for linking household and healthcare provider data for estimating effective coverage: a systematic review.

OBJECTIVE: To assess existing knowledge related to methodological considerations for linking population-based surveys and health facility data to generate effective coverage estimates. Effective coverage estimates the proportion of individuals in need of an intervention who receive it with sufficient quality to achieve health benefit. DESIGN: Systematic review of available literature. DATA SOURCES: Medline, Carolina Population Health Center and Demographic and Health Survey publications and handsearch of related or referenced works of all articles included in full text review. The search included publications from 1 January 2000 to 29 March 2021. ELIGIBILITY CRITERIA: Publications explicitly evaluating (1) the suitability of data, (2) the implications of the design of existing data sources and (3) the impact of choice of method for combining datasets to obtain linked coverage estimates. RESULTS: Of 3805 papers reviewed, 70 publications addressed relevant issues. Limited data suggest household surveys can be used to identify sources of care, but their validity in estimating intervention need was variable. Methods for collecting provider data and constructing quality indices were diverse and presented limitations. There was little empirical data supporting an association between structural, process and outcome quality. Few studies addressed the influence of the design of common data sources on linking analyses, including imprecise household geographical information system data, provider sampling design and estimate stability. The most consistent evidence suggested under certain conditions, combining data based on geographical proximity or administrative catchment (ecological linking) produced similar estimates to linking based on the specific provider utilised (exact match linking). CONCLUSIONS: Linking household and healthcare provider data can leverage existing data sources to generate more informative estimates of intervention coverage and care. However, existing evidence on methods for linking data for effective coverage estimation are variable and numerous methodological questions remain. There is need for additional research to develop evidence-based, standardised best practices for these analyses.